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Extremal principles are fundamental in our interpretation of phenom- 
ena in nature. One of the best known examples is the second law of 
thermodynamics,^ i governing most physical and chemical systems and 
stating the continuous increase of entropy in closed systems. Biological 
and social systems, however, are usually open and characterised by self- 
organised structures. Being results of an evolutionary optimisation 
process, one may conjecture that such systems use resources like en- 
ergy very efficiently, but there is no proof for this. Recent results on 
driven systems!!! indicate that systems composed of competing entities 
tend to reach a state of self-organised optimality associated with mini- 
mal interaction or minimal dissipation, respectively. Using concepts from 
non-equilibrium thermodynamics^ Bill and game theoretical ideas ,00 we 
will show that this is universal to an even wider class of systems which, 
generally speaking, have the ability to reach a state of maximal overall 
"success". This principle is expected to be relevant for driven systems in 
physics, but its main significance concerns biological and social systems, 
for which only a limited number of quantitative principles are available 
yet. 
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Recent simulations of driven multi-particle or multi-agent systems have revealed 
different kinds of self-organised states that seem to optimise certain aggregate quan- 
tities. Hence, in analogy with the concept of "self-organised criticality" for systems 
driving themselves to a critical state,0 it is natural to introduce the concept of 
"self-organised optimality". As a specific example, one can consider the formation 
of human trail systems^ where it is the discomfort of walking multiplied by the 
length of the individual ways that is minimised (cf. Figure |TJ). 

Here, we will focus on the dynamics of pedestrian crowds, allowing the intuitive and 
clear illustration of the non-trivial mechanisms behind self-organised optimality. In 
crowds of oppositely moving pedestrians, usually lanes of uniform walking direction 
develop^ (cf. Figure ||). Obviously, this self-organised collective pattern of motion 
maximises the average speeds and minimises interactions, since pedestrians would be 
considerably slowed down by avoidance maneuvers, if the desired walking directions 
were mixed. 

To prove minimal interaction, we will set up continuum equations for the considered 
systems, but at the same time, we will generalise the problem to arbitrary kinds 
of populations a that are composed of identical moving entities a. In the above 
examples, the different populations correspond to different origin-destination pairs 
and desired walking directions, respectively. The distribution of the N a entities of 
population a over the locations x of an n-dimensional space will be represented by 
the densities p a (x, t) > 0. The space does not need to be real. It may be an abstract 
one. In the case of trail formation, for example, a point x in space corresponds to 
a path connecting origin and destination. 

Assuming conservation of the number 
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d n x p a (x,t) 



(1) 



of entities in each population a, we 



obtain the continuity equation: 



dp a (x,t) 
dt 



+ V- p a {x,t)V a (x,t) =0. 



(2) 



Here, V a (x,t) is the average velocity of entities of population a. We will assume 
that this is given by the gradient 



of some function S a of the densities p&. The existence of such a function requires the 
potential condition dV ai (x)/dxj = dV a j(x)/dxi to be true, but sometimes it can be 
relaxed. In particular, it is not fulfilled in our pedestrian model. However, assuming 
homogeneity in si-direction, we can reduce the problem to the investigation of 
the one-dimensional dynamics in 22-direction, for which the potential condition is 
satisfied. 

The first terms of a series expansion of S a (x,t) give 



but the constants S® do not matter at all. The function S a (x,t) may be interpreted 
as the "(expected) success" per unit time for an entity of population a at location 
x, as it is plausible that the entities move into the direction of the greatest increase 
of success, corresponding to the gradient @. Positive S a b belong to profitable or 
attractive interactions between populations a and b, whereas competitive or repulsive 
interactions correspond to negative S a f,. If an entity of kind a interacts with entities 




(3) 




(4) 



b 
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of kind b at a rate and the associated result of the interaction can be quantified by 
some "payoff" P a b, we have the relation S a b = v ah P ah . However, the above equations 
differ from the conventional game dynamical equationsS'El in several respects: 1. 



interactive motion in space with the possibility of local agglomeration at a fixed 
number of entities in each population. 2. The payoff does not depend on the 
variables that the individual entities can change (i.e. the spatial coordinates Xj). 

3. Individuals can only improve their success by redistributing themselves in space. 

4. The increase of success is not proportional to the difference with respect to the 
global average of success, but to the local gradient of success in a population. 

Now, we will proof that, for symmetric interactions with Sba = S a b, the overall 
success 



is a so-called Lyapunov function which monotonically increases in the course of 
time, just like some thermodynamic non-equilibrium potentials.il Because of (|l|), 
we eventually obtain dS{t)/dt = J2 a J d n x dp a (x,t)/dt J2b{S a b + Sb a )pb(x,t). By 
inserting @ and @, and applying (|J), we get dS(t)/dt = —2J2afd n x'V ■ 
[p a {x, t)V5' a (a;, t)][S a (x, t) — S%]. Making use of partial integration and the Gaus- 
sian integral theorem (for systems with periodic boundary conditions), we finally 
arrive at 



We have a topology (like in the game 




define abstract games for 




(i 



(5) 



dS(t) 



2J2 I d n xp a (x,t) [VS a (x,t)] 2 >0 



(6) 



dt 



a 



This result establishes self-optimisation for symmetical interactions and can be 
easily transferred to discrete spaces (see Figure |3|). Notice that S(t) is bounded 
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for any finite system and that (|6]) looks similar to dissipation functions in 
thermodynamics.0i'il If we interpret the function —dS(t)/dt as a measure of dis- 
sipation per unit time in the system, Eq. (|6|) immediately implies that the system 
approaches a state of minimal dissipation. 

According to (|B|), the stationary solution p s ^(x) is characterised by 

pf (*) = or VS^x) = £ S ab Vpf(x) = (7) 

b 

for all a, which is fulfilled by homogeneous or step-wise constant solutions. For the 
case of two species, a linear stability analysis shows that the homogeneous solution 
(cf. Figure H(A)) is unstable if 

pT^Saa + Pb° m Sbb > Or SabSba > S aa Sbb , (8) 

where p^ om = N a /V denotes the homogeneous density and V the volume of the 
system. The latter condition in (0) is, for example, fulfilled for lane formation by 
pedestrians, since their interaction rate is proportional to their relative velocity, 
which is much higher for oppositely moving pedestrians than for pedestrians with 
the same desired walking direction. 

Under the condition (§), the stable stationary solution corresponds to complete 
segregation which, together with (0), implies that the system reaches a state of 
self-organised optimality. Notice that the global optimum is reached by means of 
short-range interactions (0). However, the regions occupied by one population need 
not be connected (cf. Figure 0(B)). If S aa < for all a, the distributions p S a(x) 
tend to be flat, as in the case of lane formation by repulsive pedestrian interactions 
(Figure 0(B)). Instead, we have agglomeration (locally peaked stationary solutions), 
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if S aa > for all a (Figures 0(C), (D)). The example of trail formation, which is 
based on attractive interactions between trails, corresponds to Figure 0(C). 

Finally, we discuss the influence of noise. Adding diffusion terms V -[Z) a V p a (x, t)] to 
the right-hand side of (|2]), the relation (0) will not be exactly valid anymore. Thus, 
optimality will be affected. Moreover, the condition (0) for segregation will become 
P* om S aa +p h b om S bb > or (S ab S ba -S aa S bb )p^p h b om > D a D b . Hence, growing diffusion 
coefficients will produce more homogeneous equilibrium states, which agrees with 
intuition. 

We call attention to the fact that there is a class of living systems (for which we have 
given some realistic examples) to which existing methods, notions, and principles 
of statistical mechanics can be successfully applied. In particular, we have proven 
that systems, which can be represented as a game between symmetrically interacting 
populations, approach a stationary state characterised by maximal overall success 
and minimal dissipation. In other words, as individual entities are trying to optimise 
their own success, a class of systems tends to reach a state with the highest global 
success. This non-trivial result is valid only under the conditions discussed above. In 
contrast to self-organised optimality, self-optimisation without a self-organised state 
occurs for symmetrical interactions, if condition (§) is not fulfilled (Figure 0(A)). 
There are also cases of self-organisation without optimality, if (H) is satisfied, but the 
interactions are not symmetrical. Such a system is exemplified by uni-directional 
multi-lane traffic of cars and lorries!, but even there one observes significantly re- 
duced interactions (lane-changing rates). Furthermore, we point out that the above 
minimal dissipation principle may be relevant to physical systems like driven granu- 
lar mediajnl but the most important implications of this generalised thermodynamic 
concept are expected for biological, social, and economic systems. 
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FIG. 1. Schematic representation of the human trail system evolving on an initially 
homogeneous ground.! When the frequency of trail usage is small, the minimal way system 
(that would connect the four entry points and destinations in the corners by direct ways) 
cannot be supported in competition with the regeneration of the vegetation. Here, by 
bundling of trails, the frequency of usage becomes large enough to support the depicted 
trail system. It corresponds to the optimal compromise between the diagonal ways and 
the ways along the edges, supplying optimal walking comfort at a minimal detour of 22% 
for everyone, which is a fair solution. 
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FIG. 2. Formation of lanes of uniform walking directions in crowds of oppositely 
moving pedestrians. Blue circles represent pedestrians walking from left to right, red 
ones represent pedestrians walking into the opposite direction. If x a (t) denotes the 
position of pedestrian a at time t, v a (t) = dx a (t)/dt its velocity, vq the desired 
speed, and e a the desired walking direction, our simplified pedestrian model reads 
v a (i) = v e a + T,p(ji a ) fap(x a (t),xp(t)). Here, f af3 represents repulsive interactions 
between pedestrians a and (3, which were assumed to decrease monotonically with their 
distance d a p(t) = \\x a (t) — xp{t)\\. For simplicity, we have specified the interactions 
as a gradient of a rotationsymmetric potential that depends only on d a p. Notice that 
lane formation is not a trivial effect of this model, but it eventually arises due the 
smaller relative velocity and interaction rate that pedestrians with the same walking di- 
rection have. It is clear that lane formation will increase the average velocity in walk- 
ing direction E(t) = ((v a ■ e a ) a ) t /vo < 1, which is a measure of "efficiency" or "suc- 
cess". (Here, ({.) a )t denotes the average over the pedestrians and over time.) Moreover, 
maximisation of efficiency immediately implies that the system minimises the quantity 
((-E/3(^ Q ) fafs • e a ) a ) t = vq- ({v a • e a ) a ) t = v (l - E), i.e., the average interaction 
against the desired direction of motion. (The average interaction perpendicular to it is 
zero.) For dissipative interactions, minimal dissipation is a direct consequence of minimal 
interactions. 
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FIG. 3. Illustration of the various forms of self-optimisation for two different popu- 
lations: (A) Homogeneous distribution in space, (B) segregation of populations without 
agglomeration, (C) attractive agglomeration, (D) repulsive agglomeration. In cases (B) to 
(D), the finally evolving optimal state is related with a self-organised, non-homogeneous 
state, which corresponds to "self-organised optimality". The above figures were obtained 
with a one-dimensional, discrete version of the game-dynamical model defined by equa- 
tions ((U) to (f|). We assumed a periodic lattice with V lattice sites x £ {1, . . . ,V} and 
two populations a £ {1,2} with a total of TV = N\ + N2 3> V entities (here: V = 40 and 
N± = N2 = 200). Furthermore, we applied the following update steps: 1. Calculate the 
successes S a (x,t) = 5° + X]& S a bn x {t)/V , where n b x (t) = pt,(x,t)V represents the number 
of entities of population b at site x. 2. For each entity a, determine a random number 
£ Q that is uniformly distributed in the interval [0, Smax] with a large constant S max (here: 
S'max = 20). 3. Move entity a belonging to population a from site x to site x + 1, if 
[S a (x + l,t) — S a (x - l,t)] > £ a , but to site x - 1, if [S a (x — l,t) — S a (x + l,t)] > £ a . 
Our simulations started with a random initial distribution of the entities. We applied a 
random sequential update rule, but a parallel update yields qualitatively the same results. 
The above figures show the numbers n x and n x = (n x + n x ) of entities as a function 
of the lattice site x at time t = 4000 and the evolution of the overall success S(t) as a 
function of time t. The fluctuations around the monotonic increase of S(t) are caused by 
the fluctuations £ a and the random sequential update. 



